On the Capacity of the 2-user Gaussian MAC 
Interfering with a P2P Link 



Anas Chaaban and Aydin Sezgin 
Emmy-Noether Research Group on Wireless Networks 
Institute of Telecommunications and Applied Information Theory 
Ulm University, 89081 Ulm, Germany 
Email: anas.chaaban@uni-ulm.de, aydin.sezgin@uni-ulm.de 



o 

> 

O 

O 

(N 



> 

in 
in 

(N 

d 



X 



Abstract — A multiple access channel and a point-to-point chan- 
nel sharing the same medium for communications are considered. 
We obtain an outer bound for the capacity region of this setup, 
and we show that this outer bound is achievable in some cases. 
These cases are mainly when interference is strong or very strong. 
A sum capacity upper bound is also obtained, which is nearly 
tight if the interference power at the receivers is low. In this case, 
using Gaussian codes and treating interference as noise achieves 
a sum rate close to the upper bound. 

Index Terms — Gaussian MAC, capacity region, strong inter- 
ference, very strong interference. 

I. Introduction 

The multiple access channel (MAC) is a scenario where 
several transmitters want to deliver one message each to one 
receiver. The capacity region of the MAC is known since 1971 
0, G). This setup models users that want to communicate 
with a base station in cell for example. 

The interference channel (IC) is another well studied model 
in information theory, that is a model where two transmit- 
receive pairs want to communicate while causing interference 
to each other. The capacity of the IC is known in some cases. 
For instance, the capacity region of the Gaussian IC with very- 
strong interference regime was obtained by 0, its capacity 
region with strong interference was obtained by 0, and its 
sum capacity with noisy interference was obtained by 0-0. 

We merge a MAC and an IC into one setup, by adding one 
more transmit-receive pair to the communications medium of 
a 2-user MAC. Then, we have a system with three transmitters 
and two receivers. The obtained setup consists of a point-to- 
point (P2P) channel interfering with with a 2-user MAC and 
we call it a (PIMAC). We study this model and obtain capacity 
results in some parameter ranges. 

We first derive an outer bound on the capacity region of the 
PIMAC. This outer bound is obtained by using a technique 
similar to Sato's technique in [4|. Then we provide an inner 
bound on the capacity region of the PIMAC, which is obtained 
by allowing both receivers to decode all messages in a MAC 
fashion. The given outer and inner bounds are shown to 
coincide in some cases. Namely, when the PIMAC has strong 
or very strong interference. 

This work is supported by the German Research Foundation, Deutsche 
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Moreover, similar to [3], a regime where interference does 
not reduce capacity is obtained. In this case, the interference 
free capacity region of the MAC as well as the capacity of the 
P2P channel can be achieved. 

The simple scheme of treating interference as noise at each 
receiver gives a sum capacity lower bound for the PIMAC. 
Using a genie aided approach similar to 0, we obtain a sum 
capacity upper bound which is very close to the lower bound 
of treating interference as noise if the interference power is 
low. 

The rest of the paper is organized as follows. In Section HU 
the PIMAC is introduced. The main outer and inner bounds are 
given in Section [Till Cases where the outer and inner bounds 
coincide are given in Section [IV] The PIMAC with weak 
interference is considered in Section [V] where sum capacity 
upper and lower bounds are given. Finally, we conclude with 
Section [VI] 

II. System Model 

A Gaussian 2-user multiple access channel (MAC) and a 
Gaussian point-to-point (P2P) channel use the same medium 
for their communication. They interfere with each other as 
shown in Figure [TJ We call the resulting setup the PIMAC, 
whose received signals can be written as 



Y\ — X\ + X2 + + Zi, 

Y2 = h\iX\ + + X% + Z2, 



(1) 

(2) 



where hij £ M denotes the channel coefficient from transmitter 
i G {1,2,3} to receiver j 6 {1>2}, X, is the transmit 
symbol of transmitter i and Zj is an additive white Gaussian 
noise (AWGN) with Zj ~ A/"(0, 1). Transmitter i has power 
constraint P, so that E[Xf] < Pi. 

The transmitters encode their messages rrij chosen indepen- 
dently from Mi — {1, . . . , 2 nRi } into a codeword of length 
n symbols X? € R n 

using encoding functions /j. Receiver 1 decodes mi and TO2 
by using a decoding function g\, i.e. (7774,777,2) = giXi), an d 
receiver 2 decodes 777,3 by using a decoding function 52, i.e. 
TO 3 = 92 A decoding error Ei occurs if m, 7^ 777^. 
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Fig. 1. Multiple Access Channel interfering with a point-to-point channel. 



An (n,2 nRl ,2" il2 ,2 nRa ) code for the PIMAC consists of 
encoding functions, decoding functions, and message sets, and 
induces an average probability of decoding error given by 

/ 3 \ 



p(n) 



1 



mGA4i x AI2 x A^3 \i=l 



(3) 



where i?s = 5Z i=1 i?i and m = (mi, TO2, 1713). A rate 
tuple (i?i, i?2, R 3 ) is achievable if there exists a sequence of 
(rc,2 niil ,2 nife ,2 nii3 ) codes such that pW] -> as n -> 00. 
The closure of the set of all achievable rates is the capacity 
region of the PIMAC denoted C, and the sum capacity is the 
highest achievable sum-rate 



Cy 



max i?£ . 

(Ri,R 2 ,R 3 )eC 



(4) 



In the next section we present an outer bound and an inner 
bound on the capacity region of the PIMAC, which we later 
show to be tight in some parameter regimes. 

III. Outer and Inner Bounds 

We start by considering the PIMAC with strong interference. 
We first use the following definition for notational conve- 
nience. 

Definition 1. We denote a multiple access channel MAC from 
transmitters i G S C {1,2,3} to receiver j G {1,2} with 
AWGN with variance 1 by M(S,j) and its corresponding 
capacity region by C M (S,j). This region is given by 



C M (S,j) 



Ri>0 Mi G S : VT C S 



Now, we are ready to state the following lemma that will 
serve as an outer bound for C. 

Lemma 1. The capacity region of the PIMAC is outer bounded 
byC, 

CCC 



where 



C = < 



{R 1 ,R 2 ,R 3 )€M 3 + : 

R 3 < ±log(l + P 3 ) 
(i?i,i? 2 )GC M ({l,2},l) 
(R U R 3 ) GC M ({1,3},2) 
(R 2 ,R 3 ) GC M ({2,3},2) 
(R U R 2 ,R 3 ) eC M ({l,2,3},l) 



if h\ 2 > 1 
ifh\ 2 > 1 
ifh\ x > 1 



Proof: The proof is based on arguments similar to Sato's 
arguments in J4[ and is given in Appendix [A] ■ 
This outer bound C given in Lemma Q] can be shown to be 
tight in some cases. For this purpose, we need an achievable 
rate region for the PIMAC, which we give in the following 
theorem. 

Theorem 1. The capacity region of the PIMAC is inner 
bounded by C, 

CCC 



where 



{R 1 ,R 2 ,R 3 )eR\ : 
C= t (R 1 ,R 2 ,R 3 )eC M ({l,2,3},l) 
(R U R 2 ,R 3 ) gC m ({1,2,3},2) 



(5) 



Proof: Each receiver simply decodes all messages in a 
MAC fashion. The achievable rates must be in the intersection 
of C M ({1, 2, 3}, 1) and C A /({1, 2, 3}, 2) and the statement of 
the theorem follows. ■ 

IV. The PIMAC with strong interference 

In general, the bounds given by C and C, given in Lemma 
[Hand Theorem Q] respectively, are not always tight. However, 
under some conditions, they coincide. These conditions are 
given in the following theorem. 

Theorem 2. If the PIMAC satisfies the following conditions 



h\ 2 Pi 



h\ 2 , h 2 2i ^31 — 1 
h h 2 22 P 2 + P 3 >Pi 



P2 + h 2 31 P 3 



(6) 
(7) 



then the outer bound C and the inner bound C coincide and 
hence, the capacity region of the PIMAC is 



C = C = C. 



(8) 



Proof: By expanding the achievable region C, and using 
conditions (O and (O, it can be shown that C reduces to C 
and the result follows. Details are given in Appendix iBl ■ 

In conclusion, if the PIMAC has strong interference, i.e. 
© is satisfied, and if (Q holds, then the capacity region of 
the PIMAC is the intersection of two MAC capacity regions, 
from all transmitters to each receiver. The capacity region of 
a PIMAC satisfying © and ^ is shown in Figure [2] 

Let us now consider special cases of the PIMAC with strong 
interference h? 12 ^h\ 2 ^h\ x > 1. According to Lemma Q] any 



achievable rate tuple (R±, R 2 , R 3 ) 
strong interference must satisfy 



for PIMAC with 



{Ri,R 3 ) GC M ({1,3},2) (9) 
{R 2 ,R 3 ) GC M ({2,3},2) (10) 
(Ri,R 2 ,R 3 ) GC M ({1,2,3},1). (11) 

where the remaining bounds R 3 < ^log(l + P 3 ) and 
(Rl,R 2 ) G C ({1,2}, 1) were removed because they are 
already included in d9l-(fTT1i. 




Fig. 2. The capacity region of a PIMAC satisfying conditions {6) and 0, 
with Pi = P 2 = P 3 = 10, hia = 1-2, han = 1.5 and hsi = 1.3. 



A. Vfery strong interference from transmitter 1 to receiver 2 

Consider a PIMAC with strong interference such that inter- 
ference from transmitter 1 to receiver 2 is very strong, 



h{ 2 > 1 



hh > 1 



P 3 



h 22 P 2 



Hi > i- 



(12) 
(13) 
(14) 



Since h\ 2 > 1 + P3 + h 22 P 2 > 1 + P 3 , then it can be shown 
that the bound (O is redundant and can be removed. Thus the 
outer bound becomes 



(R U R 2 ,R 3 ) eR\ : 
(P 2 ,P 3 ) eC M ({2,3},2) 
(Ri,R 2 ,R 3 ) gCm({1,2,3},1) 



Moreover \v\ 2 > 1 + P 3 



'22^2 



1 



■ log 1 



h\ 2 Pi 



I + P3 



h\ 2 P 2 



> 2log(l 



(15) 



Pi)- (16) 



This means that the second receiver can decode AT™ while 
treating X 2 and X£ as noise without imposing an additional 
rate constraint on the achievable rates. Then by subtracting 
the contribution of X{ 1 from Y 2 , and decoding X 2 and X£ 
in a MAC fashion at the second receiver, the rate region 
C M ({2, 3},2) can be achieved. If the first receiver decodes 
all signals in a MAC fashion, the rate region Cm ({1, 2, 3}, 1) 
can be achieved. Therefore we have the following theorem. 

Theorem 3. If the PIMAC satisfies rf72l-rf74t then its capacity 
region is 



(R U R 2: R 3 ) ER 3 + : 
C={ (R 2 ,R 3 )GC M ({2,3},2) 

(Rt,R 2 ,R 3 ) eCM({l,2,3},l) 



(17) 



Similarly if interference from transmitter 2 to receiver 2 is 
very strong. 



B. Very strong interference from transmitter 3 to receiver 1 
Suppose that the PIMAC has 

h\ 2 > 1 



h\ 2 > 1 

''31 



(18) 
(19) 

hi 1 >l + P 1 +P 2 . (20) 
In this case, the rate restriction (fTTI) can be replaced with 

{Ri,R 2 ) eC M ({l,2},l), (21) 

which follows since the rate upper bounds on R 3 , Ri + R 3 , 
R 2 + R 3 , and Ri+R 2 + R 3 are all redundant given (Ri,R 3 ) £ 
Cm({1,3},2) and (R 2l R 3 ) £ C M ({2, 3}, 2). Therefore, the 
following capacity outer bound holds 

(R U R 2 ,R 3 ) £R 3 + : 

R 3 ) G Ca/({1, 3}, 2) 
(R 2 ,R 3 ) eCM({2,3},2) 
(R U R 2 ) gCm({1,2},1) 

This outer bound can be achieved if we add one more 
condition on the PIMAC as we show next. If d20b holds then 
receiver 1 can decode X£ while treating JT" and X 2 as noise 
without imposing an additional rate constraint on 7713. This 
follows since ( 120b =$> 



> . 



(22) 



ilog(i 



h 2 31 P 3 



> ilog(l+P 3 ) 



. (23) 

Pi + p 2 ; ' 

Thus, receiver 1 can remove the contribution of X£ from Y™ 
and then decode X[ l and X 7 2 l achieving C M ({1,2},1). Let 
receiver 2 decode all signals in a MAC fashion achieving the 
region (R U R 2 ,R 3 ) G C M ({1, 2, 3}, 2). If we have 

h\ 2 P x + h 2 22 P 2 > (Pi + P 2 )(l + P 3 ), (24) 

then the bound on Pi +P2 + P3 in Cm({1, 2, 3}, 2) becomes 
redundant and can be removed. This follows since 



h\ 2 P x + h\ 2 P 2 > (P x + P 2 )(l + P 3 ) 



(25) 



- log(l + h\ 2 P x + h\ 2 P 2 



P 3 ) > ^ !og(l + Pi + Pi) 
1 



-log(l + P 3 ). (26) 

Thus, under condition (f24l > and given (Ri,R 2 ) G 
C M ({1, 2}, 1) we can replace (R U R 2 ,R 3 ) G C M ({1, 2, 3}, 2) 
by 

(Pi,P 2 ) GC M ({1,2},2) 
(Pi,P 3 ) GC M ({1,3},2) 
(R 2 ,R 3 ) gC m ({2,3},2). 

Now, since the region Cm({1,2},2) 
Cm({1, 2}, 1), we obtain the following theorem. 

Theorem 4. // the PIMAC satisfies §]M-ft2Q and §24$, then 
its capacity region is 

(Ri,R 2 ,R 3 )€R 3 + : 
, (Pi,P 3 ) GC M ({1,3},2 
^ (R 2 ,R 3 ) gCm({2,3},2 
(Pi,P 2 ) GC M ({1,2},1 



(27) 
(28) 
(29) 

larger than 



(30) 




Fig. 3. The capacity region of a PIMAC satisfying conditions )18M20t and 
|2lJ, with Pi = P 2 = Ps = 10, hia = 4.3, h 22 = 2, and h 3 i = 4.6. 



This region is shown in Figure [3] for a setup with Pi = 

Pi=Pz = 10, hxz = 4.3, h 22 = 2 and h 31 = 4.6. 

C. The PIMAC with very strong interference 

Consider now the PIMAC with very strong interference such 
that 

h\ 2 ,h 2 22 >l + P 3 (31) 
&31 > 1 + ^1+^2. (32) 

In this case, interference does not reduce capacity, i.e. the 
capacity region of the interference free MAC M({1, 2}, 1) can 
be achieved by (Ri,R 2 ) and the point-to-point capacity R 3 = 
5 log(l+P3) can also be achieved. Clearly, the following outer 
bound holds for the PIMAC 

{R U R 2 ,R 3 ) eM.\: ) 
fl 3 < §log(l + P 3 ) \. (33) 

{Ri,R 2 ) GC M ({1,2},1) J 

This outer bound can be achieved under the given conditions 
(1311 and (l32l by decoding interference first at each receiver 
while treating the desired signal as noise, and then decoding 
the desired signal after removing the contribution of interfer- 
ence. Thus, as if interference is not present, the capacity region 
of the pIMAC becomes as given in the following theorem. 

Theorem 5. If the PIMAC satisfies 071 ) and ( 1321 ), then its 
capacity region is 

f {R 1 ,R 2 ,R 3 ) eR 3 + : ) 
C={ R 3 <±log(l + P 3 ) \. (34) 

{ (Ri,R 2 ) eC M ({l,2},l) J 

As example for this case, the capacity region of a PIMAC 
with very strong interference is shown in Figure |4] 




Fig. 4. The capacity region of a PIMAC satisfying conditions {6) and 0, 
with Pi = P 2 = P3 = 10, h 12 = h 22 = 3.5, and /131 = 4.6. 



V. The PIMAC with weak interference 

In 0-Q, a genie aided technique was used to obtain a sum 
capacity upper bound for the IC that coincides with the simple 
lower bound of treating interference as noise. Thus the sum 
capacity of the IC in the so-called noisy interference regime 
was obtained. We use a similar technique to that used in [5| 
to obtain an upper bound for the PIMAC. This upper bound 
is stated in the following theorem. 

Theorem 6. The sum capacity of the PIMAC is upper bounded 
by Ce, i.e. 

where 

Cs = min I(X 1 g, X 2 q] Y x q, Sic) + H^3Gj Y 2 g, S 2 q) 

|pi|>|pa|<l, 
)7i<l-/>3. 
»72<1-Pi 

(35) 

with XiG ~ A/"(0, Pi), YiQ is the corresponding channel 
output when the input is Xiq and 

Sig = huXio + h 22 X 2G + rjiWi (36) 
S 2G = h 31 X 3G + mW 2 , (37) 

where W, — Af(0, 1) for i G {1, 2} such that E[W t Zi] = pi. 

Proof: We use a genie aided approach similar to to 
bound Ri + R 2 and R 3 . After adding the bounds, we observe 
that their sum is maximized by Gaussian inputs and we obtain 
the upper bound. Details are given in Appendix [C] ■ 
A trivial sum capacity lower bound is obtained by using 
Gaussian codes and treating interference as noise. The result- 




SNR(dB) 

Fig. 5. Sum Capacity upper bound and lower bound for an IMAC with 
P 1= P 2 = P 3 = P, h 12 = hsi = 0.2, and h 2 2 = 0.1. 



ing lower bound is given by 



<?E>£ S = 5l0g(l 



Pl+P2 
1 + h 2 31 P 3 



Pi 



1 + hi 2 Pi + h 2 P : 



(38) 



In Figure [5] we plot the upper bound Cs and the lower 
bound C s as a function of SNR, the ration between the 
transmit power and the noise variance, for an IMAC with 
Pi = P 2 = P 3 = P, hi2 = h 31 = 0.2, and h 22 = 0.1. Notice 
that this upper bound is nearly tight up to some value of SNR. 
Intuitively, this means that below some threshold value of the 
interference power, treating interference as noise achieves sum 
rate very close to the sum capacity Cs- 

Remark 1. In the special case of h\ 2 = h 22 = h, then the 
PIMAC becomes similar to a 2-user IC with transmit signals 
X™ + X% and X 3 . In this case, the bounds Cs in Theorem 
© and C s in ^ coincide if \h\(l + /131P3) + \h 31 \(l + 
h 2 {P 1 +P 2 ))<l. 

VI. Conclusion 

We studied a setup where a 2-user Gaussian multiple access 
channels interferes with a point-to-point Gaussian channel. We 
studied this setup under strong and very strong interference. 
We obtained the capacity region for some parameter regions. 
We also derived a sum capacity upper bound, which is very 
close to a sum capacity lower bound obtained by using Gaus- 
sian codes and treating interference as noise if the interference 
power is low. 
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Appendix A 
Proof of LemmaQ] 

Clearly, for any achievable rate triple (Pi, R 2 , R 3 ), the rate 
R 3 is upper bounded by the interference free capacity of the 
P2P channel, and the rate couple (Ri,R 2 ) is included in the 
capacity region of the interference free MAC M({1,2}, 1), 
i.e. 

1 



P 3 < -log(l + P 3 ) 
(R u R 2 )eC M ({l,2},l). 



(39) 
(40) 



Now we derive the other bounds. A genie gives m 2 as 
additional information to the second receiver. The obtained 
genie aided channel has a larger capacity region than the 
original PIMAC and can be used to outer bound C. Now 
consider a rate tuple (Ri, R 2 , R 3 ) in the capacity region of 
the genie aided channel. This means that the first receiver 
and the second receiver are able to decode (mi,m 2 ) and 
m 3 reliably respectively. Since the second receiver is able to 
decode 7713, and since it knows m 2 from the genie, then it is 
able to construct 



r™ = 



Y4 



h 22 X 2 — X3 



/'* 12 



XI 



h 3 \Xl 



= X\ 



XI 



h 3 iX 3 + - — Z. 
nil 



(41) 



If h\ 2 > 1, then Yj" is a less noisy version of Y™. So if the 
first receiver is able to decode mi then so does the second 
receiver. Thus (Ri,R 3 ) is contained in the MAC region of 
M({2,3},2),i.e. 



(R u R 3 )eC 



({1,3}, 2) if h\ 2 >\. 



Similarly, we can show that 

(P 2 ,P 3 )eC M ({2,3},2) if h 2 22 >l. 



(42) 



(43) 



Finally, for any rate triple (Ri, R 2 , R 3 ) € C, the first receiver 
is able to decode mi and m 2 reliably. Thus, if h 2 x > 1, 
receiver 1 can construct a less noisy version of Y 2 and then 
decode m 3 reliably leading to the bound 



(Pi,P 2 ,P 3 ) eC M ({1,2,3}, 1) if h 2 31 > 1. 

and the statement of the Lemma is proved. 



(44) 



Appendix B 
Proof of Theorem[2] 

We can expand the achievable region C to obtain the 
following rate constraints for the achievable region 





Ri 


< 


2 + 


minfP!,^!}) 








< 


\ log(l + 


min{P 2 ,^ 2 P 2 }) 






P 3 


< 


~log(l + 


rnin^/^Pa}) 




Pi - 


hP 2 


< 


~log(l + 


min{Pi + P 2 ,h 2 12 P 1 + h 2 22 P 2 }) 


Pi - 


hi?3 


< 


~ log(l + 


mm{P 1 + h 2 31 P 3 ,h 2 12 P 1 + 




P 2 - 


hP 3 


< 


\ log(l + 


min{P 2 + h 2 31 P 3l h\ 2 P 2 + 




P 2 - 


hi?3 


< 


^log(l + 


mm{P 1 + P 2 + h 2 31 P 3 , 





h 2 2 p 1 + h 2 22 p 2 + p 3 }) 

Using conditions © and @, these constraints reduce to 





Pj 


< 


^log(l- 


nP), Vz G {1,2,3} 


Pl- 


hp 2 


< 


~log(l- 


hPx + P 2 ) 


Pl- 


FP 3 


< 


5 log(l - 


rP+^Pa) 


Pl- 


KP 3 


< 


5 log(l - 


h/i^+Pg) 


P2 - 


hP 3 


< 


\ log(l - 


- P 2 + /i^Pa) 


p 2 - 


hP 3 


< 


^ log(l - 


h /il 2 P 2 + P 3 ) 


Pi + P2 - 


hP 3 


< 


^ log(l - 


h Pi + P 2 + /&P3). 



Expanding C when conditions © and (O hold lead to the 
same rate constraints. Thus, the two regions C and C coincide 
and the result follows. 

Appendix C 
Proof of Theorem[6] 

Consider the following signals 

S? = h 12 X[ l + h 22 X% + Vl Wl l (45) 
S 2 " = h 31 XS + m W? (46) 

where 77, G R and M^™ is an i.i.d. sequence with VFi ~ A/"(0, 1) 
for i G {1,2} such that E[WjiTj] = p t . A genie gives these 
signals as extra information to the receivers. Thus, receiver i 
knows both Y™ and £?" and uses them for decoding. Using 
Fano's inequality, we have 



where ei„, e 2n — > as n — > 00. Using the chain rule, we can 
write 

n(Pi + P 2 - e ln ) < I(X{\ X 2 "; S?) + I(X{\ X 2 "; J?|S?) 

= h(S?) - h(S?\X?, X%) + h(Yf\S?) 
-h(Y?\S?,X?,X2). (49) 

Similarly 

n(R 3 - e 2n ) < h(S%) - h{S2\Xg) + h{Y?\S$) 

-h(Y 2 n \S2,X%). (50) 

The next step is to show that sum of the above quantities (|49l 
and ( T50b are maximized when Xf is i.i.d. Gaussian for all 
i G {1,2,3}, i.e. X, - A/"(0,P*) where P* < P 2 . We will 
denote that Gaussian X, as and the corresponding outputs 
as YiG and S^g. Since the Gaussian distribution maximizes the 
conditional differential entropy under a covariance constraint, 
we have 

h(Y?\S?)<nh(Y 1G \Si G ) (51) 
h(Y 2 n \S^)<nh(Y 2G \S 2G ). (52) 

Furthermore, the terms h(S?\X?,X$) and h{S r 2 L \X%) are in- 
dependent of the distribution of Xi. Now, we jointly maximize 
the difference h(S?) - h(Y 2 n \S 2 \ X%) as follows 

h(s?)-hp?\s$,xs) 

= h(h 12 x? + h 22 x% + mw?) 

- h{h 12 X? + h 22 X% + Z%\W?) (53) 

( ^ h(h 12 X[ l + h 22 XJ? + m w?) 

- h(h 12 X{ 1 + h 22 X r 2 l + V 2 n ) (54) 

(b) , 

< nh(h 12 X 1G + h 22 X 2G + 771 Wi) 

- nh(h 12 X 1G + h 22 X 2G + V 2 ) (55) 
= nh(S 1G ) - nh(Y 2G \S 2G ,X 3G ,X iG ), (56) 

where (a) follows from [5, Lemma 6] with U 2 ™ being an i.i.d. 
Gaussian sequence with V 2 ~ Af(0, 1 — p 2 ) and (b) from the 
worst case noise [8| such that ij 2 < 1 — p\. Since rfc < 1 — p\, 
(l56l > can be shown to be increasing in P* and P 2 * and thus 
is maximized by ~ M(0, Pi). Similarly, if rj 2 < 1 — pf, 
h(S%) - h{Y?\S^,X?,X%) can be shown to be maximized 
by X iG ~JV(0,Pi). Moreover, ft(^iGf|SiG) and /i(Y 2G |5 2G ) 
can be shown to be increasing in P* and thus also maximized 
by X lG ~ A/"(0, Pi). As a result, by letting n — > 00 

Pi + P 2 + P 3 

< I(X 1G , X 2G - Y XG , S lG ) + I(X 3G] Y 2G , S 2G ) (57) 

with X lG - AT(0, P) and 77, < 1 - 



n(Pi + P 2 ) < J(JfT, X 2 "; 17, S?) + ne ln (47) 
nR 3 < I(X%; Y 2 n ,S2) + ne 2n (48) 



